Challenges and opportunities of multimodal data in human learning: The computer science students' perspective

Multimodal data have the potential to explore emerging learning practices that extend human cognitive capacities. A critical issue stretching in many multimodal learning analytics (MLA) systems and studies is the current focus aimed at supporting researchers to model learner behaviours, rather than directly supporting learners. Moreover, many MLA systems are designed and deployed without learners' involvement. We argue that in order to create MLA interfaces that directly support learning, we need to gain an expanded understanding of how multimodal data can support learners' authentic needs. We present a qualitative study in which 40 computer science students were tracked in an authentic learning activity using wearable and static sensors. Our findings outline learners' curated representations about multimodal data and the non-technical challenges in using these data in their learning practice. The paper discusses 10 dimensions that can serve as guidelines for researchers and designers to create effective and ethically aware student-facing MLA innovations.     

Unsupervised Scale-Consistent Depth Learning from Video

International Journal of Computer Vision - We propose a monocular depth estimation method SC-Depth, which requires only unlabelled videos for training and enables the scale-consistent...     

Flow-based local optimization for image-to-geometry projection

The projection of a photographic data set on a 3D model is a robust and widely applicable way to acquire appearance information of an object. The first step of this procedure is the alignment of the images on the 3D model. While any reconstruction pipeline aims at avoiding misregistration by improving camera calibrations and geometry, in practice a perfect alignment cannot always be reached. Depending on the way multiple camera images are fused on the object surface, remaining misregistrations show up either as ghosting or as discontinuities at transitions from one camera view to another. In this paper we propose a method, based on the computation of Optical Flow between overlapping images, to correct the local misalignment by determining the necessary displacement. The goal is to correct the symptoms of misregistration, instead of searching for a globally consistent mapping, which might not exist. The method scales up well with the size of the data set (both photographic and geometric) and is quite independent of the characteristics of the 3D model (topology cleanliness, parametrization, density). The method is robust and can handle real world cases that have different characteristics: low level geometric details and images that lack enough features for global optimization or manual methods. It can be applied to different mapping strategies, such as texture or per-vertex attribute encoding.     

Evolutionary Generalized Radial Basis Function neural networks for improving prediction accuracy in gene classification using feature selection

Radial Basis Function Neural Networks (RBFNNs) have been successfully employed in several function approximation and pattern recognition problems. The use of different RBFs in RBFNN has been reported in the literature and here the study centres on the use of the Generalized Radial Basis Function Neural Networks (GRBFNNs). An interesting property of the GRBF is that it can continuously and smoothly reproduce different RBFs by changing a real parameter τ. In addition, the mixed use of different RBF shapes in only one RBFNN is allowed. Generalized Radial Basis Function (GRBF) is based on Generalized Gaussian Distribution (GGD), which adds a shape parameter, τ, to standard Gaussian Distribution. Moreover, this paper describes a hybrid approach, Hybrid Algorithm (HA), which combines evolutionary and gradient-based learning methods to estimate the architecture, weights and node topology of GRBFNN classifiers. The feasibility and benefits of the approach are demonstrated by means of six gene microarray classification problems taken from bioinformatic and biomedical domains. Three filters were applied: Fast Correlation-Based Filter (FCBF), Best Incremental Ranked Subset (BIRS), and Best Agglomerative Ranked Subset (BARS); this was done in order to identify salient expression genes from among the thousands of genes in microarray data that can directly contribute to determining the class membership of each pattern. After different gene subsets were obtained, the proposed methodology was performed using the selected gene subsets as new input variables. The results confirm that the GRBFNN classifier leads to a promising improvement in accuracy.     

Strong accumulators from collision-resistant hashing

Accumulator schemes were introduced in order to represent a large set of values as one short value called the accumulator. These schemes allow one to generate membership proofs, that is, short witnesses that a certain value belongs to the set. In universal accumulator schemes, efficient proofs of non-membership can also be created. Li et?al. (Proceedings of applied cryptography and network security—ACNS ’07, LNCS, vol 4521, 2007), building on the work of Camenisch and Lysyanskaya (Advances in cryptology—proceedings of Crypto ’02, LNCS, vol 2442. Springer, Berlin, pp 61–76, 2002), proposed an efficient accumulator scheme, which relies on a trusted accumulator manager. Specifically, a manager that correctly performs accumulator updates. In this work, we introduce the notion of strong universal accumulator schemes, which are similar in functionality to universal accumulator schemes, but do not assume the accumulator manager is trusted. We also formalize the security requirements for such schemes. We then give a simple construction of a strong universal accumulator scheme, which is provably secure under the assumption that collision-resistant hash functions exist. The weaker requirement on the accumulator manager comes at a price; our scheme is less efficient than known universal accumulator schemes—the size of (non)membership witnesses is logarithmic in the size of the accumulated set in contrast to constant in the scheme of Camenisch and Lysyanskaya. Finally, we show how to use strong universal accumulators to solve a problem of practical relevance, the so-called e-Invoice Factoring Problem.     

Complementary Effects of Carbamylated and Citrullinated LL37 in Autoimmunity and Inflammation in Systemic Lupus Erythematosus

LL37 acts as T-cell/B-cell autoantigen in Systemic lupus erythematosus (SLE) and psoriatic disease. Moreover, when bound to “self” nucleic acids, LL37 acts as “danger signal,” leading to type I interferon (IFN-I)/pro-inflammatory factors production. T-cell epitopes derived from citrullinated-LL37 act as better antigens than unmodified LL37 epitopes in SLE, at least in selected HLA-backgrounds, included the SLE-associated HLA-DRB1*1501/HLA-DRB5*0101 backgrounds. Remarkably, while “fully-citrullinated” LL37 acts as better T-cell-stimulator, it loses DNA-binding ability and the associated “adjuvant-like” properties. Since LL37 undergoes a further irreversible post-translational modification, carbamylation and antibodies to carbamylated self-proteins other than LL37 are present in SLE, here we addressed the involvement of carbamylated-LL37 in autoimmunity and inflammation in SLE. We detected carbamylated-LL37 in SLE-affected tissues. Most importantly, carbamylated-LL37-specific antibodies and CD4 T-cells circulate in SLE and both correlate with disease activity. In contrast to “fully citrullinated-LL37,” “fully carbamylated-LL37” maintains both innate and adaptive immune-cells’ stimulatory abilities: in complex with DNA, carbamylated-LL37 stimulates plasmacytoid dendritic cell IFN-α production and B-cell maturation into plasma cells. Thus, we report a further example of how different post-translational modifications of a self-antigen exert complementary effects that sustain autoimmunity and inflammation, respectively. These data also show that T/B-cell responses to carbamylated-LL37 represent novel SLE disease biomarkers.     

The GAUGAA Motif Is Responsible for the Binding between circSMARCA5 and SRSF1 and Related Downstream Effects on Glioblastoma Multiforme Cell Migration and Angiogenic Potential

Circular RNAs (circRNAs) are a large class of RNAs with regulatory functions within cells. We recently showed that circSMARCA5 is a tumor suppressor in glioblastoma multiforme (GBM) and acts as a decoy for Serine and Arginine Rich Splicing Factor 1 (SRSF1) through six predicted binding sites (BSs). Here we characterized RNA motifs functionally involved in the interaction between circSMARCA5 and SRSF1. Three different circSMARCA5 molecules (Mut1, Mut2, Mut3), each mutated in two predicted SRSF1 BSs at once, were obtained through PCR-based replacement of wild-type (WT) BS sequences and cloned in three independent pcDNA3 vectors. Mut1 significantly decreased its capability to interact with SRSF1 as compared to WT, based on the RNA immunoprecipitation assay. In silico analysis through the “Find Individual Motif Occurrences” (FIMO) algorithm showed GAUGAA as an experimentally validated SRSF1 binding motif significantly overrepresented within both predicted SRSF1 BSs mutated in Mut1 (q-value = 0.0011). U87MG and CAS-1, transfected with Mut1, significantly increased their migration with respect to controls transfected with WT, as revealed by the cell exclusion zone assay. Immortalized human brain microvascular endothelial cells (IM-HBMEC) exposed to conditioned medium (CM) harvested from U87MG and CAS-1 transfected with Mut1 significantly sprouted more than those treated with CM harvested from U87MG and CAS-1 transfected with WT, as shown by the tube formation assay. qRT-PCR showed that the intracellular pro- to anti-angiogenic Vascular Endothelial Growth Factor A (VEGFA) mRNA isoform ratio and the amount of total VEGFA mRNA secreted in CM significantly increased in Mut1-transfected CAS-1 as compared to controls transfected with WT. Our data suggest that GAUGAA is the RNA motif responsible for the interaction between circSMARCA5 and SRSF1 as well as for the circSMARCA5-mediated control of GBM cell migration and angiogenic potential.     

Comparison of Repeated Doses of C-kit-Positive Cardiac Cells versus a Single Equivalent Combined Dose in a Murine Model of Chronic Ischemic Cardiomyopathy

Using a murine model of chronic ischemic cardiomyopathy caused by an old myocardial infarction (MI), we have previously found that three doses of 1 × 10⁶ c-kit positive cardiac cells (CPCs) are more effective than a single dose of 1 × 10⁶ cells. The goal of this study was to determine whether the beneficial effects of three doses of CPCs (1 × 10⁶ cells each) can be fully replicated by a single combined dose of 3 × 10⁶ CPCs. Mice underwent a 60-min coronary occlusion; after 90 days of reperfusion, they received three echo-guided intraventricular infusions at 5-week intervals: (1) vehicle × 3; (2) one combined dose of CPCs (3 × 10⁶) and vehicle × 2; or (3) three doses of CPCs (1 × 10⁶ each). In the combined-dose group, left ventricular ejection fraction (LVEF) improved after the 1st CPC infusion, but not after the 2nd and 3rd (vehicle) infusions. In contrast, in the multiple-dose group, LVEF increased after each CPC infusion; at the final echo, LVEF averaged 35.2 ± 0.6% (p < 0.001 vs. the vehicle group, 27.3 ± 0.2%). At the end of the study, the total cumulative change in EF from pretreatment values was numerically greater in the multiple-dose group (6.6 ± 0.6%) than in the combined-dose group (4.8 ± 0.8%), although the difference was not statistically significant (p = 0.08). Hemodynamic studies showed that several parameters of LV function in the multiple-dose group were numerically greater than in the combined-dose group (p = 0.08 for the difference in LVEF). Compared with vehicle, cardiomyocyte cross-sectional area was reduced only in the multiple-dose group (−32.7%, 182.6 ± 15.1 µm² vs. 271.5 ± 27.2 µm², p < 0.05, in the risk region and −28.5%, 148.5 ± 12.1 µm² vs. 207.6 ± 20.5 µm², p < 0.05, in the noninfarcted region). LV weight/body weight ratio and LV weight/tibia length ratios were significantly reduced in both cell treated groups vs. the vehicle group, indicating the attenuation of LV hypertrophy; however, the lung weight/body weight ratio was significantly reduced only in the multiple-dose group, suggesting decreased pulmonary congestion. Taken together, these results indicate that in mice with chronic ischemic cardiomyopathy, the beneficial effects of three doses of CPCs on LV function and hypertrophy cannot be fully replicated with a single dose, notwithstanding the fact that the total number of cells delivered with one or three doses is the same. Thus, it is the multiplicity of doses, and not the total number of cells, that accounts for the superiority of the repeated-dose paradigm. This study supports the idea that the efficacy of cell therapy in heart failure can be augmented by repeated administrations.     

Confocal Blood Flow Videomicroscopy of Thrombus Formation over Human Arteries and Local Targeting of P2X7

Atherothrombosis exposes vascular components to blood. Currently, new antithrombotic therapies are emerging. Herein we investigated thrombogenesis of human arteries with/without atherosclerosis, and the interaction of coagulation and vascular components, we and explored the anti-thrombogenic efficacy of blockade of the P2X purinoceptor 7 (P2X7). A confocal blood flow videomicroscopy system was performed on cryosections of internal mammary artery (IMA) or carotid plaque (CPL) determining/localizing platelets and fibrin. Blood from healthy donors elicited thrombi over arterial layers. Confocal microscopy associated thrombus with tissue presence of collagen type I, laminin, fibrin(ogen) and tissue factor (TF). The addition of antibodies blocking TF (aTF) or factor XI (aFXI) to blood significantly reduced fibrin deposition, variable platelet aggregation and aTF + aFXI almost abolished thrombus formation, showing synergy between coagulation pathways. A scarce effect of aTF over sub-endothelial regions, more abundant in tissue TF and bundles of laminin and collagen type I than deep intima, may suggest tissue thrombogenicity as molecular structure-related. Consistently with TF-related vascular function and expression of P2X7, the sections from CPL but not IMA tissue cultures pre-treated with the P2X7 antagonist A740003 demonstrated poor thrombogenesis in flow experiments. These data hint to local targeting studies on P2X7 modulation for atherothrombosis prevention/therapy.